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Sumnary 


This  study  investigates  the  use  of  an  external  criterion  for  validating 
additive  utility  assessments  under  certainty.  Utilities  >»ere  elicited  from 
twenty-four  groups  via  consensus  judgment  for  ten  hypothetical  applicants 
for  bank  credit  cards.  The  research  design  completely  crossed  two  factors 
relevant  to  group  utility  assessment:  (1)  using  a decomposition  (MAUA) 
procedure  or  not,  and  (2)  using  a formal  group  communication  strategy  or  not. 
The  quality  of  each  group's  utility  judgments  was  defined  to  be  the  Pearson 
product-moment  correlation  between  the  group’s  judged  utilities  and  utilities 
Output  from  a configural  (nonlinear)  model  used  by  Security  Pacific  National 
Bank  in  evaluating  applicants  for  Master  Charge.  Group  satisfaction  measures 
were  also  obtained.  The  decomposition  methodology  and  the  group  communication 
strategy  both  aided  groups  in  making  assessments  that  are  more  consistent  with 
those  of  the  bank  model,  which  is  based  on  a systematic  collection  and  inter- 
pretation of  a large  amount  of  relevant  data.  Simplified  procedures  for 
obtaining  weight  parameters  in  the  multi -attribute  utility  analysis  yielded 
better  overall  utilities  than  more  complicated  ratio-estimation  techniques. 
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FIGURE 


Figure  1.  Average  person  product-moment  correlations  between 
subjective  group  evaluations  and  four  different  objective  criteria. 
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INTRODUCTION 


The  difficulties  groups  encounter  in  arriving  at  collective  decisions 
are  well  recognized  in  the  adage  that  a camel  is  the  product  of  a group  set- 
ting out  to  build  a horse.  Research  has  identified  a number  of  interpersonal 
factors  inhibiting  group  performance  on  problem-solving  tasks  (Hoffman,  1965): 
pressures  toward  uniformity  (caused  either  by  a priori  expectations  of  unanim- 
ity or  the  threat  of  majority  rule);  participation  biases  (fear  of  rejection 
and  group  reliance  on  talkative  members);  personality  characteristics  of 
dominant  group  member  unrelated  to  cognitive  ability;  concentration  of  power; 
and  failure  to  search  for  problems.  Janis  (1972)  illustrated  the  problems 
inherent  in  overly  conformist  group  behavior  with  historical  data  from  a 
number  of  foreign  policy  decisions  resulting  in  international  fiascoes  (e.g.. 
Pearl  Harbor,  Bay  of  Pigs).  Scrutinizing  these  group  decision-making  situations, 
Janis  observed  that  group  outputs  are  often  highly  dependent  upon  needs  to  have 
warm  feelings  of  solidarity  and  consensus.  This  often  leads  to  inhibition  of 
free  expression  of  ideas  and  failure  to  realistically  appraise  alternative 
courses  of  action. 

In  his  extensive  review  of  the  group  problem-solving  literature,  Hoffman 
(1965)  noted  that  "most  of  the  experiments  to  date  have  concentrated  on 
identifying  the  barriers  to  effective  problem  solving,  rather  than  on  discover- 
ing means  to  stimulate  group  creativity  (p.  127)."  A decade  later,  little  had 
changed.  In  an  excellent  review  chapter,  Hackman  and  Morris  (1975)  concluded 
that  although  "there  is  no  dearth  of  small  group  intervention  techniques 
available. . .relatively  little  research  has  been  done  to  assess  the  value  of 
Such  techniques  for  improving  group  task  effectiveness  (pp.  92-93)."  In 
general,  small  group  intervention  techniques  can  be  classified  as  either 
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interpersonal  (designed  to  improve  the  quality  of  group  members'  relationships) 
or  procedure-oriented  (providing  specific  strategies  for  more  effective  task 
performance).  Based  on  rather  skimpy  research,  Hackman  and  Morris  (1975) 
asserted  that  "interpersonal  interventions  are  powerful  in  changing  patterns 
of  behavior  in  the  group--but  that  task  effectiveness  is  rarely  enhanced  (and 
often  suffers)  as  a consequence,"  whereas  procedure-oriented  interventions 
"often  may  be  helpful  in  improving  effectiveness  of  the  task  immediately  at 
hand,  but  rarely  can  they  be  incorporated  readily  into  the  ongoing  process  of 
the  group  (Hackman  & Morris,  1975,  p.  93)."  If  Hackman  and  Morris  are  correct, 
the  obvious  next  step  is  to  develop  and  test  interpersonal  and  procedural 
techniques  in  concert  with  one  another. 

We  studied  the  independent  and  combined  effects  of  two  normative  inter- 
ventions, one  interpersonal  and  one  procedural,  on  the  performance  of  ad  hoc 
three-person  laboratory  groups.  The  interpersonal  technique  was  that  of  a 
group  communication  strategy  first  proposed  by  Hall  and  Watson  (1971).  The 
procedural  technique  employed  was  that  of  multi-attribute  utility  measurement 
(MaM'M)  a decision  aid  developed  within  the  last  ten  years  (Keeney  & Raiffa, 
1976).  We  chose  to  use  a simplified  version  of  MAUM,  first  proposed  by  Edwards 
(1972),  called  SMART  (simple  multi-attribute  rating  technique).  (See  Edwards, 
1977.)  A discussion  of  the  theoretical  rationale  and  empirical  support  for 
both  of  these  normative  interventions  follows. 

An  Interpersonal  Intervention:  Group  Cormunication  Strategy 

Several  distinct  programs  of  research  have  attempted  to  tackle  the  inter- 
personal problems  inherent  in  group  decision-making.  In  each  case,  the 
primary  goal  is  to  help  groups  reach  a consensus  decision  that  optimizes  the 
resources  of  the  group.  We  will  briefly  review  four  of  these  approaches,  con- 
centrating on  the  comnuni cation  strategy  intervention  we  tested. 


aggregation.  One  way  to  avoid  problems  caused  by  bringing 
individuals  together  is  not  to  bring  them  together.  The  mathematical  aggrega- 
tion technique  ignores  the  existence  of  the  group  identity  by  treating  group 
preferences  as  no  more  than  a collection  of  individual  preferences.  Although 
combining  individual  judgments  by  some  algebraic  rule  seem  straightforward 
and  practically  appealing,  it  is  not  without  difficulitie*' 

Arrow  (1951)  demonstrated  one  of  the  most  serious  problems  for  mathematical 
aggregation  in  his  Nobel-Prize-winning  work  on  social  choice.  He  proved  that  it 
is  impossible  to  combine  a set  of  two  or  more  individual  preference  orderings 
over  three  or  more  alternatives  into  a group  preference  ordering  that  satisfies 
a reasonable  set  of  assumptions.  A good  review  of  Arrow's  work,  along  with  a 
discussion  of  several  attempts  to  weaken  his  conclusions  (e.g.,  Fishburn,  1973; 
Keeney  & Kirkwood,  1975;  Pattanaik,  1971)  is  offered  by  Seaver  (Note  1).  We 
tend  to  agree  with  Seaver's  conclusion  that  "all  of  the  formal  procedures  for 
aggregating  individual  preferences  or  utilities  into  group  preferences  or 
utilities  have  some  undesirable  traits  (Seaver,  Note  1,  p.  14).  " 

Restricted  interaction.  Two  of  the  more  popular  restricted-interaction 
procedures  are  the  Delphi  method  (Dal key,  1969a),  developed  by  Norman  Dalke^, 

Olaf  Helmcr,  and  their  associates  at  the  Rand  Corporation,  and  the  nominal 
group  technique  (Delbecq,  Van  de  Ven,  & Gustafson,  1974),  developed  by  Andre 
Delbecq,  Andrew  Van  de  Ven,  and  their  associates  at  the  University  of  Wisconsin. 
Both  procedures  include  the  following  four  steps:  (1)  individual  judgment 
assessment,  (2)  feedback  of  all  individual  judgments  to  the  group,  (3)  individual 
reconsideration  of  judgments,  and  (4)  mathematical  aggregation  of  revised 
judgments.  Individual  judgments  are  made  anonymously  in  the  Delphi  procedure, 
publicly  in  the  nominal  technique.  Also,  1 imited  group  discussion  for  purposes 
of  clarification  and  explanation  is  allowed  after  the  feedback  stage  for 
nominal  groups;  Delphi  groups  are  allowed  no  interaction  beyond  anonymous  feed- 
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From  a practical  perspective,  allowing  limited  group  Interaction  Is 
probably  more  difficult  than  prohibiting  Interaction  altogether.  In  addition, 
Delphi  and  nominal  groups  suffer  from  the  already  mentioned  problems  with 
mathematical  aggregation.  The  empirical  research  on  11ml ted- Interaction 
techniques,  reviewed  extensively  by  Seaver  (Note  1),  provluc  far  from  impressive 
support  (e.g.,  see  Dalkey,  1969d,  1969b;  Nemiroff,  Passmore,  & Ford,  1976; 

Seaver,  Note  2). 

Social  judgment  theory.  Analysis  of  Interpersonal  conflict  Is  a major 
“heme  in  the  programmatic  research  carried  out  by  Hammon,  Brehmer,  and  their 
colleagues  under  the  heading  of  social  judgment  theory  (SJT;  Brehmer,  1976; 
Hammond,  1973;  Hammond,  Stewart,  Brehmer,  & Steinmann,  1975).  (This  social 
judgment  theory  is  theoretically  tied  to  Brunswick's  "lens  model"  (Haimond, 

1966;  Slovic  & Lichtenstein,  1971)  and  seems  to  bear  virtually  no  relationship 
with  the  well-known  social  judgment  theory  of  Sherif  and  Hovland  (1961),  related 
to  persuasion  and  attitude  change.)  Although  SJT  was  initially  concerned  with 
studying  the  cognitive  characteristics  of  conflict  situations  (Hammond,  Wilkins, 

& Todd,  1966),  recent  developments  have  suggested  that  SJT  analyses  of  inter- 
personal conflict  might  be  useful  for  bringing  groups  of  divergent  individuals 
closer  to  consensus  (Brehmer,  1976).  Within  the  procedure,  individuals  are 
presented  with  choice  alternatives  for  evaluation.  After  making  private  evalu- 
ations, individual  judgments  are  made  public  to  all  group  members.  group 
is  then  required  to  reach  a consensus  judgment  via  free  discussion.  By  pro- 
gramming the  technique  for  interactive  use  with  a computer,  various  descriptive 
statistics  Inferred  from  the  individual  and  group  judgments  can  also  be  used 
as  feedback.  Brehmer  (1976)  summarizes  three  examples  of  SJT  applications 
showing  that  "the  cognitive  differences  could  be  identified  and  accounted  for" 
and  that  "It  was  possible  to  resolve  conflict  by  means  of  cognitive  aids 
developed  within  social  judgment  theory  (Brehmer,  1976,  p.  1001)." 

An  early  experiment  by  Hanmond,  Todd,  Wilkins,  and  Mitchell  (1966,  Study 
II)  demonstrated  that  the  nature  of  the  discussion  allowed  group  members  in 
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reaching  consensus  produced  little  effect  on  group  policy  Indices.  However, 
one  might  suppose  that  the  same  interpersonal  difficulties  cited  by  Hoffman 
(1965)  might  arise  in  the  (unrestricted)  discussion  phase  of  the  SJ7  conflict 
resolution  paradigm,  thus  producing  personality  biases  in  the  resulting  group 
policy.  Unfortunately,  "there  have  been  no  studies  of  the  effects  of  personality 
characteristics  on  conflict  (Brehmer,  1976,  p.  998)"  Thus,  v<hile  the  social 
judgment  theorists  are  free  from  the  criticisms  linked  to  mathematical  aggrega- 
tion of  individual  judgments,  they  have  not  avoided  the  interpersonal  issues 
inherent  in  groups  striving  for  consensus  judgments.  Parenthetically,  it  is 
interesting  to  note  the  conrional ity  of  individual  judgment  feedback,  found  in 
both  the  restricted  interaction  (Delphi  and  nominal)  and  the  SJT  procedures. 

Communication  strategy.  A conmunication  strategy  is  simply  a set  of 
verbal  instructions  to  the  group  members  about  how  to  discuss  and  resolve 
differences  optimally.  The  rationale  comes  from  Hall  and  Watson  (1971),  who 
hypothesized  that: 

A normative  statement  which  would  break  the  strain  toward  conver- 
gence and  require  a consensual  resolution  of  conf 1 icts--wh i le 
specifying  a number  of  confronting  and  obstructive  behaviors  as 
legitimate  and  required- -would  elicit  and  sustain  a group  process 
which,  irrespective  of  member  attitude,  would  allow  untrained  groups 
to  function  more  effectively  than  they  normally  would  under  the 
normative  system  which  they  themselves  would  bring  to  the  enterprise 
(pp.  301-302). 

The  exact  set  of  six  guidelines  proposed  and  tested  by  Hall  and  Watson  (1971) 
are  listed  in  the  Appendix.  Briefly,  they  instruct  group  members  to  (1)  avoid 
arguing,  (2)  avoid  "win-lose"  statements,  (3)  avoid  changing  their  opinions 
only  in  order  to  avoid  conflict  and  to  reach  agreement  and  harmony,  (4)  avoid 
conflict-reducing  techniques  such  as  the  majority  vote,  averaging,  bargaining, 
coin-flipping,  (5)  view  differences  of  opinion  as  both  natural  and  helpful 


rather  than  a hindrance  in  decision-making,  and  (6)  view  initial  agreement 
as  suspect. 

Several  direct  tests  of  the  conwunication  strategy  proposed  by  Hall  and 
Watson  (1971)  have  been  made.  Using  middle-  and  upper-level  management  per- 
sonnel from  several  small  businesses.  Hall  and  Watson  (1971)  demonstrated 
markedly  superior  performance  for  groups  employing  their  communication  strategy. 
The  task  was  the  "NASA  moon  survival  problem",  which  requires  subjects  to  rank 
order  fifteen  items  of  equipment  in  terms  of  their  Importance  for  survival 
(see  Hall,  1963).  An  expert  solution  to  the  problem  has  been  obtained  from  the 
Crew  Equipment  Research  Section  of  the  NASA  Manned  Spacecraft  Center  in  Houston, 
Texas.  The  expert  ordering  thus  provides  a criterion  measure  of  performance 
against  which  group  responses  may  be  compared  and  evaluated.  Hall  and  Watson 
(1971)  found  significant  increments  in  communication  strategy  groups'  perform- 
ance in  terms  of  group  error  score  and  gain  over  the  average  group  member's 
response.  Of  most  interest  is  the  finding  that  7S%  of  the  communication 
strategy  groups  realized  the  assemby  effect  bonus  (i.e.,  group  prediction  more 
accurate  than  the  individual  decision  of  the  group's  most  accurate  member), 
compared  to  only  25%  for  the  control  group. 

Nemiroff  and  King  (1975)  replicated  this  finding  with  college  undergraduates. 
Using  only  a slightly  modified  version  of  the  Hall  and  Watson  (1971)  communica- 
tion strategy,  they  obtained  the  same  gains  in  performance  on  the  moon  survival 
problem  for  groups  exposed  to  the  normative  interpersonal  intervention.  For 
their  study,  over  twice  as  many  conmuni cation  strategy  groups  as  control  groups 
(72%  vs.  33%)  achieved  the  assembly  effect  bonus.  In  yet  another  replication, 
Nemiroff  et.  al.  (1976)  compared  the  Hall  and  Watson  communication 
strategy,  in  Its  pure  form,  to  both  the  nominal  group  technique  (Del^ecq  et 
al.,  1974)  and  a control  group.  The  task  employed  was  the  "lost  at  sea" 
problem  (Nemiroff  & Passmore,  1975),  similar  to  the  moon  survival  problem. 
Undergraduate  students  enrolled  in  an  organizational  behavior  class  were  required 
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to  rank  a set  of  fifteen  items  In  the  order  of  Importance  to  survival  at  sea. 

An  objectively  correct  rank-ordering,  supplied  by  officers  of  the  United  States 
Merchant  Marines,  was  used  as  the  standard  of  performance.  The  communication 
strategy  groups  significantly  outperformed  the  other  two  groups  in  terms  of 
absolute  error  score,  as  well  as  in  gain  over  the  average  group  member's  error 
score.  No  differences  were  obtained  between  the  nominal  and  conventional 
process  groups.  Finally,  although  half  (505)  of  the  communication  strategy 
groups  achieved  the  assembly  effect  bonus,  only  33%  and  8%  of  the  nominal  and 
conventional  groups  did  so,  respectively. 

Using  a similar  communication  training  technique  developed  by  Blake  and 
Mouton  (1962),  Hall  and  Williams  (1970)  found  significant  differences  in  per- 
formance between  trained  and  untrained  groups  of  college  students  (under- 
graduate psychology  students),  management  personnel  recruited  from  industry 
(ranging  from  foreman  to  president),  and  psychiatric  patients  (ranging  from 
anxiety  reactions  to  personality  disorders).  The  problem  task  for  the  groups 
was  to  predict  the  order  in  which  eleven  jurors  in  the  movie  "Twelve  Angry  Men" 
would  change  their  verdicts  from  guilty  to  not  guilty  (also  used  by  Hall, 
Mouton,  & Blake,  1963,  and  Hall  & Williams,  1966).  After  observing  jurors  for 
38  minutes  of  film  time,  groups  made  predictions  "based  on  what  was  to  occur 
in  the  film,  taking  all  possibilities  and  reasons  into  account,  rather  than  on 
the  validity  or  accuracy  of  the  author's  reasoning  in  developing  his  characters 
(Hall  & Williams,  1970,  p.  46)."  Thus,  the  true  order  in  which  the  jurors 
eventually  changed  their  verdicts  constitutes  a criterion  against  which  to 
measure  group  orderings.  Groups  using  the  communication  strategy  developed  by 
Blake  and  Mouton  (1962)  obtained  lower  error  scores  and  realized  a larger  gain 
in  performance  over  the  average  individual  response.  In  addition,  half  (50%) 
of  the  conmuni cation  strategy  groups  realized  the  assembly  effect  bonus,  while 
only  13%  of  the  control  group  did  so. 

These  studies  by  Hall  and  his  associates  and  Nemiroff  and  his  associates 
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yield  strong  empirical  evidence  supporting  the  comnunication  strategy  approach 
to  interpersonal  problems.  Based  on  the  excellent  findings  from  these  four 
studies,  we  believe  that  Hackman  and  Morris's  (1975)  negative  conclusions 
regarding  the  effects  of  interpersonal  Intervention  techniques  on  group 
product  may  have  been  somewhat  premature.  At  the  least.  Hall  and  Nemiroff's 
findings  provide  a happy  exception  to  the  rule. 

A Procedure-Oriented  Intervention:  MAUM 

Multi -attribute  utility  theory  and  measurement  is  a recent  extension  of 
modern  utility  theory  as  it  developed  from  the  landmark  work  of  von  Neumann 
and  Morgenstern  (1944).  (For  good  reviews  of  MAUM,  see  Fishburn,  1977;  Huber, 
1974;  MacCrimmon,  1973;  von  Winterfeldt  & Fischer,  1975;  Fischer,  Note  3; 
Fischer,  Edwards,  & Kelly,  Note  4.)  MAUM  provides  a decomposed  evaluation 
procedure  as  a means  of  improving  upon  the  intuitive  decision-making  process. 
Decomposition  methods  divide  the  overall  evaluation  task  into  a set  of  simpler 
Sub-tasks,  each  of  which  is  within  the  judgmental  capacities  of  the  decision- 
maker. Our  application  of  MAUM  to  the  group-decision  problem  requires  that 
group  members  express  their  judgments  collectively  as  if  they  were  functioning 
as  a single  decision-maker  employing  the  formal  analysis. 

Applications  of  multi-attribute  utility  measurement  typically  involve  the 
following  steps;  (1)  an  initial  listing  of  the  set  of  alternative  courses  of 
action  to  be  evaluated,  (2)  specification  of  a set  of  attributes  with  respect 
to  which  each  alternative  can  be  evaluated,  (3)  numerical  assessment  of  the 
value  of  each  alternative  with  respect  to  each  attribute,  (4)  rank-ordering 
and  ratio-scaling  of  each  attribute  in  terms  of  importance,  and  (5)  employ- 
ment of  an  arithmetic  evaluation  rule  (a  model)  to  determine  the  overall  value 
of  each  alternative. 

Multi-dimensional  value  assessment  and  multi-attribute  utility  analysis 
have  been  criticized  on  the  grounds  that  the  use  of  a mathematical  combination 
rule  (either  additive  or  multiplicative)  ignores  configure  1 interaction  between 
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the  attributes  of  the  outcomes  being  considered,  and  that  these  Interactions 
are,  in  fact,  taken  into  consideration  by  decision  makers  at  an  intuitive 
level.  Major  research  efforts  (Slovic  t Lichtenstein,  1971)  have  greatly 
weakened  this  objection  by  demonstrating  that  holistic  or  intuitive  judgments 
can  be  very  well  approximated  by  even  a simple  additive  model. 

Research  also  supports  the  notion  that  simply  providing  more  structure  in 
the  group  process  of  determining  preferences  will  reduce  disagreement  among  the 
members  of  the  groups.  Gardiner  and  Edwards  (1975)  found  that  less  disagree- 
ment among  two  groups  of  land  management  planners  (conservationists  and  develop- 
ers) occurred  when  a highly-structured  multi-attribute  utility  procedure  was 
employed  to  determine  preference  than  when  simple  holistic  (unaided,  intuitive) 
judgments  were  elicited  from  the  group.  Subsequent  research  by  Gardiner  and 
Ford  (in  press)  replicates  this  original  finding  and  lends  support  to  the  notion 
that  these  procedures  not  only  reduce  disagreement,  but  also  help  the  group 
focus  on  the  exact  points  of  disagreement,  which  can  then  be  considered  specific 
ally. 

The  most  comnon  approach  to  utility  validation  has  been  to  measure  conver- 
gent validity,  or  the  degree  to  which  different  model  forms  and  elicitation 
procedures  correspond  to  one  another.  Correlations  among  a variety  of  models 
(risky  and  riskless,  multiplicative  and  additive)  and  assessment  techniques 
(holistic  and  decomposed)  have  been  found  to  consistently  range  in  the  high 
.80's  and  .90's  (Fischer,  1976,  1977;  von  Winterfeldt  & Edwards,  Note  5). 

Subtle  differences  have  been  uncovered  using  more  sensitive  techniques  of 
analysis,  however.  Fischer's  (1976)  conjoint  measurement  analysis  revealed 
marked  violations  of  independence  assumptions  not  discovered  through  correla- 
tional analysis.  Consistent  violations  of  attribute  independence  leading  to 
mul ti -attribute  risk  aversion  are  reported  by  von  Winterfeldt  (Note  6).  On 
the  whole,  however,  few  serious  discrepancies  among  model  forms  and  elicitation 
procedures  have  been  discovered  (Fischer  et  al..  Note  4). 
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METHOD 

Overview 

In  order  to  explore  the  effects  of  two  normative  interventions  on 
group  decision  behavior,  a complex  and  realistic  decision-making  task  was 
chosen.  The  task  required  each  group  to  evaluate  the  worth  (to  Security 
Pacific  National  Bank)  of  ten  applicants  for  revolving  credit  loans  made 
via  the  bank-issued  credit  and  Master  Charge.  This  task  was  chosen  because 
it  provided  several  independent  criteria  against  which  to  validate  each 
group  decision.  Each  of  24  groups  (drawn  from  two  university  populations) 
employed  one  of  four  experimental  procedures  (created  by  completely 
crossing  two  normative  interventions)  in  evaluating  the  ten  applicants.  Upon 
completion  of  the  task,  individual  reactions  to  various  aspects  of  the  group's 
experience  were  obtained  via  a set  of  seven-interval  semantic-differential 
scales. 
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Subjects 

Graduate  students  and  upper-division  undergraduates  enrolled  at 
the  University  of  California,  Los  Angeles,  and  the  University  of  Southern 
California  were  solicited  to  participate  in  the  experiment.  Each  was 
told  that  the  study  would  involve  an  exercise  in  group  decision-making 
which  might  provide  experience  valuable  in  future  professional  settings; 
however,  no  direct  compensation  was  offered.  Seventy-two  subjects  volun- 
teered to  participate  in  groups  of  three.  All  subjects  within  each  group 
were  acquainted.  None  of  the  subjects  indicated  any  specific  knowledge  of  the 
credit  evaluation  process. 

Procedure 

Each  of  the  twenty- four  groups  met  once  with  the  experimenter  in 
quiet  locations  for  time  periods  ranging  from  one  to  three  hours,  depending 
upon  the  speed  at  which  the  group  worked.  All  twenty-four  groups  were 
given  two  decision  tasks,  each  of  which  required  the  group  to  make  a 
consensus  judgment  regarding  the  relative  values  of  the  choice  alternatives 
provided.  The  first  problem,  which  involved  seven  hypothetical  apartments 
identified  on  three  dimensions  of  worth  (monthly  rent,  distance  from  work, 
and  quality  of  neighborhood),  was  used  as  warm-up  exercise  to  familiarize 
the  subjects  with  the  task,  assessment  instrumentation,  and  experimental 
setting.  Although  data  were  collected  for  this  portion  of  the  experiment, 
no  analyses  were  conducted  and  no  further  reference  to  the  task  will  appear. 

The  alternatives  for  the  second  task  consisted  of  ten  applicants  for 
a bank  charge  card,  each  of  which  was  described  on  ten  dimensions: 
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1.  Credit  rating  and  verification  thereof 

2.  Age 

3.  Employment  type 

4.  Estimated  spendable  funds  per  month 

5.  Industry  category 

6.  Level  of  education 

7.  Marital  status 

8.  Whether  the  applicant  owns  or  rents  living  quarters,  holds 
an  oil  company  credit  card,  and  has  a telephone 

9.  Number  of  years  at  current  address 

10.  Number  of  years  on  present  job 

An  example  of  one  the  ten  alternative  applicant  descriptions  follows: 

APPLICANT  B 

Applicant  B is  57  years  old  and  has  an  excellent  credit  rating  with  complete 
Information  adequately  verified.  The  applicant  has  13  - 15  years  of  education 
and  is  a hospital  assistant  for  a nursing  service.  The  applicant  has  estimated 
spendable  funds  of  $261.00  per  month,  is  divorced,  has  lived  at  his  current 
address  for  six  years  and  has  held  his  present  position  for  nine  years. 

Applicant  B rents  an  apartment  and  has  a telephone  and  major  oil  company  credit 
card. 


Groups  were  required  to  assign  a number  to  each  applicant  reflecting 
that  applicant's  value  to  the  bank  as  a charge  card  holder. 

Utility  Assessment 

Twelve  groups  made  holistic  assessments  of  applicant  worth  and  twelve 
performed  a decomposed  assessment,  similar  to  Edwards'  (1977)  SMART  (Simple 
Multi-Attribute  Rating  Technique)  procedure.  Holistic  groups  were  required 
simply  to  rank-order  the  ten  applicants  in  terms  of  their  desirability  as 
cardholders  to  the  bank.  In  addition,  holistic  groups  made  a dollar  estimate 
of  the  credit  limits  to  be  assigned  to  each  applicant.  These  credit  limits 
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(constrained  to  the  interval  $500  to  $3500,  as  in  the  criterion  bank 
model)  constituted  the  holistic  groups'  utility  assessment  of  the 
choice  alternatives. 

Decomposed  assessments  were  completed  in  two  parts.  First,  groups 
assessed  the  worth  of  each  of  the  ten  applicants  on  each  of  the  ten  dimensions 
of  importance.  Using  a scale  anchored  at  the  two  endpoints  (0  ■ worst 
applicant  on  dimension  and  100  • best  applicant  on  dimension),  groups 
produced  one  hundred  "location  measures",  u^^,  (l^l,  i«T0),  representing 
the  value  of  the  Uh  applicant  on  the  Jth  dimension. 

During  the  second  half  of  the  decomposition  assessment  procedure, 
an  importance  weight  for  each  dimension  was  determined.  First,  each  group 
rank- ordered  the  ten  dimensions  upon  which  the  applicants  were  described 
from  the  most  important  (*  10)  to  the  least  important  (■!).  Next,  the 
group  assigned  weights,  w.'  (1- j - 10),  representing  the  relative 

J 

importance  of  the  Jth  attribute.  Weights  were  elicited  via  a standard 

ratio  scaling  technique,  whereby  the  least  important  dimension  is  first 

assigned  a weight  of  10  and  the  others  are  assigned  weights  so  that  the 

ratio  of  any  pair  of  weights  represents  the  number  of  times  more  important 

one  dimension  is  than  another.  The  elicited  ratio  weights  were  then 

normalized  to  sum  to  one,  i.e.,w.  ■ w-' /I®  w.'.  Additionally,  each 

-J  -J  j.]  -J 

group  was  asked  to  group  the  ten  attributes  into  four  categories: 

0 - Not  at  all  important 

1 - Little  importance 

2 -Moderate  importance 

3 -Highly  important 
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The  number  assigned  to  each  attribute  (0>3)  was  recorded  as  a "rating" 

of  the  Importance  of  that  dimension.  Thus,  three  sets  of  empirical  weights 

were  elicited:  (1)  rank  weights,  (2)  ratio  weights,  and  (3)  rate  weights. 

The  overall  utility  of  the  1th  applicant  Is  determined  by  aggregating 

the  location  measures  and  one  of  the  weight  vectors.  (Alternatively,  one 

could  Ignore  all  three  sets  of  empirical  weights  and  simply  assume  equal 

weighting  I.e.  w^  »1,  1-  j-  10.)  One  aggregation  rule  Is  a simple  weighted 

10 

sum  across  the  ten  dimensions:  Utility  of  the  1th  applicant  ■ ■!  w.  u... 

-1  -J  -u 

Previous  research  (cited  above)  suggests  that  the  additive  rule  Is  a good 
approximation  to  more  complicated  function  forms,  even  when  the  necessary 
assumptions  of  utility  Independence  are  not  met.  Thus,  our  analysis  Is 
restricted  to  the  additive  aggregation,  as  assumed  In  the  SMART  procedure 
(Edwards,  1977). 

Cownunlcation  Strategy 

Six  of  the  holistic  groups  and  six  of  the  decomposition  groups  were 
given  the  group  conmunication  strategy  adapted  from  Hall  and  Watson  (1971, 
p.  304).  The  communication  strategy,  as  described  above,  consists  of  six 
statements  outlining  suggested  policies  for  efficiently  dealing  with  the  group 
Interaction  situation  (see  Appendix).  Groups  were  trained  in  the  conmunication 
strategy  for  approximately  fifteen  minutes.  The  text  of  the  appendix  was 
read  aloud  to  the  entire  group,  and  questions  were  then  answered.  A large 
poster  display  of  the  communication  strategy  was  present  throughout  the  group 
interaction. 

The  remaining  twelve  groups  were  given  no  additional  instructions  regard- 
ing the  decision  task. 

Post-Decision  Measures 

Inmedlately  following  completion  of  the  group  decision  task,  each 
subject  responded  to  a set  of  eight  semantic  differential  scales  concerning 
various  subjective  Impressions  of  the  group  Interaction.  On  a seven-point 
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scale,  subjects  indicated  their  perceptions  of  the  difficulty  and  complexity 
of  the  decision  task,  their  satisfaction  with  the  decision-making  technique, 
and  their  commitment  to  the  group  decision.  In  addition,  subjects  rated 
the  frequency  with  which  group  discussion  involved  the  repetition  of  ideas 
and  suggestions,  the  frequency  with  which  each  person  was  able  to  speak, 
the  frequency  with  which  voices  were  raised  in  group  discussion,  and  the 
extent  to  which  group  discussion  centered  around  or  resulted  from  direction 
by  one  person. 

Bank  Model 

The  ten  applicants  were  selected  from  a sample  of  8000  charge  card 
applicants  whose  files  (names,  address,  and  other  identifying  information 
withheld)  were  obtained  from  a major  C^ilifornia  bank.  The  bank  has  developed 
a complex  mathematical  model  to  evaluate  applicants  for  charge  cards,  based 
on  information  obtained  from  a standard  application  form.  These  bank  model 
scores  constituted  an  "objective"  criterion  of  worth,  against  which  subjective 
assessments  may  be  compared. 

Historically,  the  existing  bank  model  was  developed  in  two  stages. 
Initially,  applicants  were  assigned  a score  which  was  a linear  function, 
the  main  component  of  which  was  disposable  monthly  income.  Applicants 
received  specific  credit  limits  based  upon  their  obtained  scored  (termed 
the  "RRA  score").  Subsequently,  a second  component  was  incorporated  into 
the  model  and  has  the  effect  of  adjusting  the  original  score  up  or  down 
as  a function  of  the  applicant's  "financial  stability".  An  applicant 
may  be  rejected  altogether  if  the  so  called  "stability  score"  is  below 
a certain  minimum.  The  stability  score  is  the  product  of  a specially 
developed  discriminant  function  designed  to  separate  potentially  profit- 
able accounts  from  unprofitable  ones. 
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The  discriminant  function  was  the  result  of  a discriminant  analysis 
carried  out  on  a sample  of  4000  good  accounts  and  4000  bad  accounts  booked 
by  the  bank  between  1970  and  1972.  The  combined  scoring  rule  yields  a 
number  between  $500.00  and  $3500.00,  which  constitutes  the  recommended 
credit  limit  to  be  granted  the  applicant.  It  should  be  noted  that,  in 
certain  cases,  the  applicant  is  rejected  outright  on  the  basis  of  individual 
attributes,  regardless  of  obtained  stability  score  or  the  number  reached  by 
the  overall  scoring  system.  Details  of  the  unique  non-linear  combination 
of  the  two  components  of  the  bank's  decision  model  (RRA  score  adjusted 
quadratical ly  according  to  the  discriminant  function  stability  score)  may  be 
found  in  Rabin  (Note  7). 

In  addition  to  the  bank  model  information  about  each  applicant,  the 
actual  line  amounts  granted  were  also  known.  In  many  cases,  the  line  amount 
granted  was  not  the  same  as  the  amount  suggested  by  the  bank  model,  as 
the  bank  allows  its.  officers  to  override  the  model's  resulting  score  if  they 
wish. 

As  one  would  expect,  the  full  bank  model  correlates  moderately  well  with 
all  of  the  other  criteria  (.45,  .58,  .65).  This  is  natural,  since  the  RRA 
score  and  Stability  score  are  combined  arithmetically  to  produce  the  full  model 
score,  and  the  line  amount  granted  is  determined  subjectively  only  after  the  full 
model  score  is  known  (normally,  the  line  amount  granted  is  the  same  as  that 
reconmended  by  the  full  bank  model).  The  other  three  correlations  are  not 
as  large,  however.  Most  notably,  the  stability  score  is  virtually  unrelated 
to  the  line  amount  granted  (.02)  and  somewhat  negatively  related  to  the 
RRA  score  (-.29).  The  RRA  score  correlated  .37  with  the  line  amount  granted. 
Thus,  the  four  bank  criteria  constitute  somewhat  different,  though  related, 
meanings  of  applicants  worth. 
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RESULTS 

Quality  of  Group  Decision 

Each  group's  evaluation  of  the  ten  applicants  was  correlated  with  the 
four  objective  criteria:  (1)  score  from  the  full  two-component  bank  mode'' - 
(2)  actual  line  amount  granted  the  applicant;  (3)  "RRA  score",  first  component 
of  bank  model;  and  (4)  "Stability  score",  second  component  of  bank  model. 

Each  group-criterion  correlation  was  first  transformed  to  a Fisher  z score  and 
averages  were  computed  over  the  six  groups  in  each  cell.  These  average  z 
scores  were  then  transformed  to  Pearson  correlations  using  the  inverse  Fisher 
z transformation.  These  average  group-criterion  correlation,  plotted  in 
Figure  1,  illustrate  the  increment  in  group  performance  due  to  use  of  the 
decomposition  evaluation  procedure  (ratio  weights)  and  the  group  communication 
strategy.  The  spacing  of  the  decomposition  line  above  the  holistic  line  in 

three  of  the  four  panels  indicates  a positive  effect  (at  least  in  direction) 
for  the  decomposition  methodology.  The  positive  slopes  on  all  eight  lines 
shown  in  Figure  1 suggest  that  the  group  communication  strategy  was  an  effective 
manipulation  for  improving  the  quality  of  group  judgments.  The  near 
parallelism  evident  in  all  four  pairs  of  lines  indicates  that  the  effects  of 
the  two  normative  interventions  combine  additively. 

The  increment  in  group  performance  resulting  from  use  of  the  SMART 
procedure  was  largest  for  the  full- bark-model  and  stability-score  criteria, 
accounting  for  36.4%  and  30.1%  of  the  total  variance,  respectively.  A 
smaller  positive  effect  resulted  from  the  decomposition  methodology  for  the 
1 ine -amount -granted  criterion  (11.7%  of  total  variance).  A negligible 
decrement  in  SMART  groups'  performance  was  evidenced  for  the  RRA  score 


1 

criterion  ( accounting  for  0.4%  of  total  variance  ). 
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Although  the  group  communication  strategy  manipulation  improved  group 
performance  for  all  four  criteria,  the  proportion  of  total  variance  accounted 
for  is  considerably  less  than  that  attributable  to  the  decomposition  metho- 
dology. Performance  was  influenced  most  greatly  for  the  ful  1- bank- model 
criterion  (10.3%  of  total  variance).  Positive  conriunication  strategy 
effects  were  evidenced  to  a smaller  extent  for  the  line  amount  granted 
(6.8%  of  total  variance)  and  RRA  score  (5.7%  of  total  variance)  criteria. 

The  effect  was  of  little  moment  for  the  stability  score  criterion  (0.7% 
of  total  variance). 

The  beneficial  influence  of  the  two  normative  interventions  was  almost 

entirely  additive  for  all  four  of  the  criteria.  Interaction  effects  accounted 

for  3.5*  of  the  total  variance  for  the  line  amount  granted,  1.0%  for  the  RRA 

score,  0.7%  for  the  stability  score,  and  0.5%  for  the  full  bank  model 
2 

criteria. 

Overall,  SMART  groups'  evaluations  corresponded  closely  to  three  of  the 
four  objective  criteria.  In  order  from  greatest  correspondence  to  least 
are  full  bank  model,  RRA  score,  line  amount  granted,  and  Stability  score. 
Holistic  groups,  however,  showed  good  correspondence  only  upon  the  RRA 
score  criterion,  followed  by  the  full  bank  model  and  line  amount  granted. 

A negative  relationship  was  observed  between  holistic  applicant  evaluations 
and  the  stability  scores.  One  might  predict  that  the  holistic  groups 
would  fare  substantially  better  on  the  line  amount  granted  than  for  the 
other  less  subjective  criteria,  due  to  the  subjectivity  inherent  in  the 
line  amount  granted;  such  was  not  the  case. 
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Weighting  Schemes  for  SMART  Groups 

Composite  utilities  were  computed  for  each  of  the  ten  applicants  using 
the  four  different  sets  of  weights  collected  from  each  of  the  twelve  groups 
employing  the  decomposition  methodology.  Correlations  were  first  computed 
over  the  ten  applicant  evaluations  for  each  pair  of  weighting  schemes. 

Average  correlations  between  weighting  schemes  were  then  computed  across 
the  twelve  SMART  groups,  utilizing  the  Fisher  £ transformation  procedure 
outlined  above.  These  correlations  are  presented  in  Table  1. 

There  is  a high  degree  of  convergence  in  the  applicant  evaluations  across 
the  four  different  weighting  schemes,  ranging  from  a low  of  .69  between 
ratio  and  unit  weighting  to  a high  of  .98  between  rate  and  rank  weighting. 

Rate  and  rank  weights  constituted  a compromise  between  the  extremeness  of 
ratio  weighting  (each  correlating  .90)  and  the  uniformity  of  unit  weighting 
(correlating  .87  and  .93,  respectively). 

Although  convergent  validity  of  weighting  schemes  would  seem  desirable, 
the  more  important  question  involves  the  issue  of  criterion  validity. 

Which  weighting  scheme  creates  composite  applicant  evaluations  which  are 
most  like  those  found  in  the  objective  bank  criteria?  To  answer  this  question, 
each  of  the  sets  of  applicant  composite  utilities  created  from  the  four 
weighting  schemes  were  correlated  with  each  of  the  four  objective  criteria. 
Average  correlations  between  each  weighting  scheme  and  each  objective 
criterion  were  then  computed  across  the  twelve  SMART  groups,  again  applying 
the  Fisher  z transformation  procedure. 
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T.ble  1;  Averse  PMrson  Product-Horcat  Correlations  Among  Poor 
Different  Weighting  Procedures. 
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The  resulting  four-by-four  matrix  for  average  correlations  are  presented 
in  Table  2.  It  should  be  noted  that  the  average  correlatiofs  In  the  first 

column  are  the  same  as  those  plotted  in  Figure  1 for  the  decomposition  groups, 
collapsed  across  the  conmunication  strategy  manipulation.  Further  support  for 
convergence  among  weighting  schemes  is  apparent.  The  ranleordering of  group- 
criterion  correlations  for  the  three  alternate  weighting  procedures  is  almost 
the  same  as  that  observed  for  ratio  weighting,  i.e.,  from  highest  correspondence 
to  lowest,  full  bank  model,  RRA  score,  line  ?Tount  granted,  and  stability  score. 
The  single  exception  is  the  reversal  of  line  amount  granted  (.47)  and  stability 
score  (.49)  for  unit  weighting. 

The  most  important  result  in  Table  2,  however,  is  the  dominance  of  the 
ratio-weighting  method  by  the  three  simpler  alternatives.  Rate  and  rank 
weighting  both  completely  dominate  ratio  weighting  on  all  four  of  the 
objective  criteria.  Unit  weighting  shows  even  stronger  dominance  for  the 
ful 1- bank- model  and  stabil ity- score  criteria,  equivalence  for  the  line- 
amount- granted  criterion,  and  slight  inferiority  for  the  RR4-score  criterion. 
Little  distinction  is  apparent  among  the  three  simplified  alternative 
weighting  schemes.  Rate  weights  achieve  the  highest  average  correlations 
for  the  RR4-score  and  line -amount- granted  criteria,  whereas  unit  weighting 
delivers  the  highest  correlations  observed  for  stability-score  and  the  full- 
bank-model  criteria.  Clearly,  the  increment  in  performance  due  to  the  use 
of  the  decomposition  method  would  be  amplified  by  the  use  of  any  of  the 


i.' 


f 


simplified  weighting  schemes  in  place  of  ratio  weighting. 


..... 
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Table  2:  Average  Pearson  Product-Moment  Correlations  Between 
Weighting  Schemes  and  Objective  Bank  Criteria 


Ratio 

Unit 

Rate 

Rank 

RRA  score 

.53 

.49 

.58 

.56 

Stabi 1 i ty 

score 

.16 

.49 

.27 

.36 

Full  bank 

model 

.60 

.80 

.76 

.79 

Line  amount 

granted 

.47 

.47 

.50 

.49 
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Inter-Attribute  and  Attribute-Model  Correlation 

In  trying  to  understand  the  superior  performance  of  unit,  rate,  and 
rank  weights  to  ratio  weights,  it  is  useful  to  inspect  the  intercorrelations 
among  the  ten  attributes  along  which  the  applicants  were  described  and  those 
between  each  attribute  and  some  criterion  measure.  Using  the  location 
measures  produced  for  each  applicant  on  each  dimension  by  the  SMART  groups 
and  the  applicant  scores  on  the  full  bank  model,  such  a correlaion  matrix 
was  produced  for  each  of  the  twelve  decomposition  groups. 

As  one  would  suspect  from  the  high  correlations  reported  among  the 
various  weighting  schemes,  there  is  a scarcity  of  large  negative  inter- 
correlations (see  Newman,  1978).  The  worst  is  only  -.83,  and  there  are 
only  four  which  are  less  than  or  equal  to  -.70;  the  median  attribute 
intercorrelation  is  .01.  However,  the  presence  of  some  negative  inter- 
correlations was  enough  to  produce  the  differential  degrees  of  correspondence 
across  weighting  schemes  shown  in  Table  2. 

The  attribute-criterion  correlation  indicated  that  SMART  groups  could 
have  obtained  substantially  better  correspondence  to  the  full  bank  model  by 
simply  weighting  either  "marital  status"  (r  =.70)  or  "owns,  rent/oil  company 
credit  card/telephone"  (r  =.81)  positively  and  all  other  dimensions  zero. 

This  revelation  suggests  that  the  group  weights  were  all  poorly  estimated. 

The  superiority  of  the  simplified  weights  is  probably  due  to  the  flattening 
of  the  distribution  of  ratio  weights  which  might  be  expected  to  result  from 
the  implementation  of  unit,  rate,  or  rank  weights.  In  other  words,  the  groups' 
lack  of  knowledge  concerning  good  importance  weights  was  less  of  a hindrance 
for  them  in  the  simplified  weighting  schemes  than  in  ratio  weighting.  Obtaining 
less  information  is  not  only  simpler,  it  is  safer  if  the  group  has  little  or  no 
information  to  provide. 
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Post-Experiment  Questions 

Each  response  to  the  eight  semantic  differential  scales  was  scored 
as  an  Integer  between  1 and  7,  inclusive,  A standard  2x2  analysis  of 
variance  was  carried  out  on  each  of  the  eight  scales  to  determine  the  pro- 
portions of  total  variance  explained  by  the  various  difference  among  marginal 
cell  means. 

The  main  benefit  of  the  SMART  procedure  seems  to  be  in  less  perceived 
repetition  of  ideas  and  suggestions  {7.29%  of  total  variance)  and  less 
frequent  raising  of  voices  in  the  group  (4.00*  of  total  variance).  Its 
implementation  does  not  seem  to  greatly  affect  the  perceived  complexity  or 
difficulty  of  the  task,  the  satisfaction  with  the  technique,  the  commitment  to 
the  decision  product,  the  degree  to  which  each  person  is  allowed  to  speak, 
or  the  extent  to  which  an  individual  dominates  the  group  discussion  (all  less 
than  2.00*  of  the  total  variance). 

The  group  communication  strategy  tended  to  reduce  the  subjects' 
perceived  level  of  task  complexity  (3.24%  of  total  variance)  and  task 
difficulty  (9.00%  of  total  variance).  Virtually  no  effect  was  created  by 
the  communication  strategy  for  satisfaction  with  the  technique,  commitment 
to  the  decision  product,  the  degree  to  which  each  person  is  allowed  to  speak, 
the  extent  to  which  an  individual  dominates  the  group  discussion, the  extent 
to  which  ideas  and  suggestion  are  repeated,  or  the  frequency  with  which  voices 
are  raised  (all  less  than  2.00%  of  the  total  variance). 


26 


DISCUSSION  AND  CONCLUSIONS 

Results  Indicate  that  use  ot  the  SMART  decision  technology  signifi- 
cantly improved  the  quality  of  collective  decisions,  as  did,  to  a lesser 
extent,  the  coimuni cation  strategy.  The  correspondence  between  the  bank 
criteria  and  group  decisions  reached  via  the  decomposition  methodology 
was  improved  when  the  ten  attribute  weights  were  obtained  from  the  simpli- 
fied assessment  schemes  of  rating,  ranking,  or  setting  all  equal  to  a 
constant.  The  reported  findings  provide  substantial  empirical  justification 
for  the  two  normative  procedures  investigated.  These  results  constitute 
strong  evidence  for  the  argument  advanced  by  Edwards  (1977)  in  support  of 
decomposed  methods  of  evaluating  complex  choice  entities. 

The  bank's  formalized  process  of  evaluating  the  applicants  for 
revolving  credit  loans  reflects,  with  some  degree  of  accuracy,  the  nature 
of  the  complex  relationship  between  applicant  characteristics  and  subsequent 
loan  performance.  Information  bearing  on  this  complex  relationship  is  a part 
of  individuals'  past  experience  (otherwise  the  choice  entities  would  appear 
equally  attractive  and  evaluation  would  be  impossible).  Thus,  the  degree  to 
which  group  decisions  correspond  to  the  bank's  systematic  and  complex  evalua- 
tion provides  a measure  of  the  match  between  the  collective  decision  elicited 
and  group  members'  experience.  It  is  argued  that  the  advanced  behavioral 
technologies  explored  by  this  research  are  valid  in  the  sense  that  they 
elicit  a more  nearly  complete  representation  of  individuals’  past  experience. 

While  multi-attribute  utility  analysis  (SMART)  was  developed  for  use 
by  individuals,  these  experimental  results  suggest  that  the  technique  is 
readily  adaptable  to  the  group-task  setting.  The  success  of  the  group 
decision  technology  lies  in  its  ability  to  focus  attention  to  individual 
value-relevant  factors.  As  reflected  by  the  improved  correlations  obtained 


with  simplified  weighting  schemes,  the  precise  specification  of  weight 
parameters  is  of  little  importance  (at  least  for  the  task  investigated). 

In  the  reported  study,  the  assessment  of  ratio  weights  merely  exhausted 
group  time  and  energy,  while  lowering  the  quality  of  the  decision  product. 

The  success  of  the  group  communir  tion  strategy  stems  from  its 
diversion  of  group  attention  away  from  interaction  not  pertaining  to 
past  experience  relevant  to  the  choice  teak.  The  group  communication 
strategy  was  designed  expressly  for  groups  making  unaided  intuitive 
judgments  in  complex  decisions.  The  effect  of  the  strategy  renders  it 
a potentially  useful  approach.  An  obvious  implication  of  this  finding 
is  the  need  for  further  development  of  the  conmunication  strategy  for 
use  in  concert  with  analytic  decision  technologies. 

Further  research  for  the  purpose  of  developing  group  multi-attribute 
utility  analysis  ought  to  explore  the  behavioral  effects  of  simplified 
weighting  schemes.  Although  a plethora  of  research  exits  on  the  mathema- 
tical characteristics  of  "equal  weights"  (Einhorn  & Hogarth,  1975;  Laughlin, 
1978;  McClelland,  in  press;  Wainer,  1976,  1978),  there  is  no  study  which 
explores  the  psychological  effects  on  individuals  or  the  group  as  a whole. 

More  complicated  assessment  procedures,  particularly  for  estimating  weight 
parameters,  may  not  provide  better  overall  utilities.  However,  there  may 
be  some  advantage  in  their  use  as  a technique  to  aid  the  decision-maker(s ) 
in  thinking  hard  about  the  choice  problem.  Further  insight  into  the  decision 
situation  may  lead  to  a revision  of  the  list  of  attributes  of  importance  or 
an  addition  to  the  specified  set  of  choice  alternatives.  Such  research  should, 
of  course, draw  heavily  upon  well-known  findings  in  the  area  of  psychophysics 
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concerning  various  response  modes  and  elicitation  techniques. 

For  those  situations  where  some  weight  assessment  is  preferred,  what 
should  be  the  order  of  assessment  of  individual  attribute  values  and  importance 
weights?  Although  Edwards  (1977)  suggests  that  weight  assessment  precede 
single  attribute  utility  assessment,  good  results  were  obtained  in  the 
present  study  using  the  reverse  ordering.  Surely,  the  decision-maker 
should  be  made  familiar  with  the  distribution  of  alternatives  over  dimensions  be- 
fore he  is  probed  for  information  concerning  the  differential  importance  of  those  dimen- 
sions.  As  pointed  out  by  Otway  and  Edwards  (Note  8),  the  set  of  choice  alternatives  may 

u 

not  be  known  prior  to  utility  assessment.  In  such  cases,  they  recoimend  that  assessed 
weights  be  mathematically  transformed  as  a function  of  the  set  of  real  alternatives 

t 

actually  present.  Although  the  idea  certainly  deserves  further  investigation,  » 

» 

other  formal  weight  transformations  should  also  be  considered.  In  particular,  f 

i 

attention  should  focus  upon  obtaining  a transformation  which  is  sensitive 
not  only  to  changes  in  the  expected  range  of  the  distribution  of  alternatives 
over  attributes,  but  also  to  changes  in  mean  and  variance  of  the  distributions. 

Although  the  normative  interventions  employed  were  well  received  by 
the  laboratory  decision-making  groups,  research  that  explores  user  attitudes 
over  a variety  of  complex  decision  settings  is  needed.  What  effect  does 
expertise  have  on  group  use  of  a communication  strategy  or  a decomposition 
decision  technology  such  as  SMART?  Perhaps  experts  combine  information  in 
a way  that  is  not  adaptable  to  the  formal  mathematical  structure  imposed 
by  multi-attribute  utility  analysis.  Is  the  conwunication  process 
of  an  established  group  in  an  organizational  setting  so  unique  that  a group 
comnunicatlon  strategy  would  become  ineffective?  Clearly,  adaptation  of 
normative  interventions  for  use  in  major  decision-making  situations  must  be 
mediated  by  concern  for  group  member  expertise  and  organizational  constraint. 
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Footnotes 


The  univariate  hypothesis  tests  for  the  SMART  effect  revealed  the 
following:  Full  bank  model,  F^^go  * 13.79.  £<.01;  SUbility  score, 
-1,20  “ Line  amount  granted,  F^  20  ' £=’•01  i RRA 

score,  ^1*®  multivariate  hypothesis  test  resulted  in  an 

overall  £ statistic  of  5.19  with  1 and  17  degrees  of  freedom,  £<.01. 
None  of  the  univariate  or  multivariate  hypothesis  tests  for  the 
group  communication  strategy  or  the  interaction  effect  were 
statistically  significant  for  a = .01. 


( 


CONTRACT  DISTRIBUTION  LIST 
(Unclastif led  Technical  Keperta) 


Director 

Advanced  Research  Projects  Agency 
Attention:  Program  Management  Office 
1400  Vllson  Boulevard 
Arlington,  Virginia  22209 


2 copies 


Office  of  Naval  Research 
Attention:  Code  453 
800  North  Quincy  Street 
Arlington,  Virginia  22217 


3 codes 


Defense  DocuTtentaticn  Center 
Attention:  DDC-TC 
Can  eron  Station 
Alexandria,  Virginia  22314 


12  cocies 


(■ 


DCASHA  Baltimore  Office 
Attention:  Mr.  K.  Cerasir. 
300  East  Joppa  Road 
Tovson,  Maryland  21204 


1 COPY 


h 


Director 

Naval  Research  Laboratory 
Attention:  Code  2627 
Washington,  D.C.  20375 


6 copies 


tavlstd  August  If 78 


SUPPLMKTAL  DISTRIBUTIOK  LIST 
(Unclassified  Technical  tcpocts) 


Depsrraent  of  Defense 


Director  of  Ket  Assessuenc 
Office  of  the  Secretary  of  Defense 
Attention:  MAJ  Robert  C.  Cough,  USAT 
The  Pentagon,  Roos  3A930 
Washington,  DC  20301 


Assistant  Director  (Net  Technical  Assessnent) 


Office  of  the  Deputy  Director  of  Defense 


Research  and  Engineering  (Test  and 
Evaluation) 

The  Pentagon,  Rooa  3C125 
Washington,  DC  20301 


Director,  Defense  Advanced  Research 
Projects  Agency 
1400  Wilson  Boulevard 
Arlington,  VA  22209 


Director,  Cybernetics  Technology  Office 
Pefense  Advanced  Research  Projects  Agency 
1400  Wilson  Boulevard 
Arlington,  VA  22209 


Director,  ARPA  Regional  Office  (Europe) 
Headquarters,  U.S.  European  Coanand 
APO  New  York  09128 


Director,  ARPA  Regional  Office  (Pacific) 

Staff  CINCPAC,  Box  13 

Casp  H.  H.  Smith,  Havaii  96661 


Dr.  Don  Mirta 

Defense  Systems  Managaent  School 

Building  202 

Ft.  Belvolr,  VA  22060 


Chairman,  Department  of  Curriculum 
Development 
National  War  College 
Tt.  McNair,  4th  and  P Streets,  SW 
Washington,  DC  20319 


Defense  Intelligence  School 
Attention:  Professor  Douglas  E.  Hunter 
Washington,  DC  20374 


N i 

. J 


Vice  Director  for  Production 
Manageaent  Office  (Special  Actions) 
Defense  Intelligence  Agency 
Room  1E863,  The  Pentagon 
Washington,  DC  20301 


Command  and  Control  Technical  Center 
Defense  Communications  Agency 
Attention:  Mr.  John  D.  Hwang 
Washington,  DC  20301 


Department  of  the  KaN-^- 


Office  of  the  Chief  of  Naval  Operations 
(OP-951) 

Washington,  DC  20450 


Office  of  Naval  Research 

Assistant  Chief  for  Technology  (Code  200) 

800  N.  Quincy  Street 

Arlington,  VA  22217 


Office  of  Naval  Research  (Code  230' 
800  North  Quinev  Street 
Arlington,  VA  '22217 


Office  of  Vaval  Research 
Naval  Analysis  Prograr.s  (Code  431) 
600  North  Quincy  Street 
Arlington,  VA  2221' 


I 


Off  let  ef  Kaval  Raavarch 

Operations  Research  Pregraas  (Code  434) 

800  North  Quincy  Street 
Arlington,  VA  22217  • 

Office  of  Kaval  taaaarch 
Infomstion  Syataas  Progras  (Code  437) 

600  North  Quincy  Street 
Arlington,  VA  22217 

Director,  OKR  Branch  Office 
Attention:  Dr.  Charles  Davis 
336  South  Clark  Street 
Chicago.  IL  60605 

Director,  0>JR  Branch  Office 
Attention:  Dr.  J.  Lester 
495  Susscr  Street 
Beston,  Mn  02210 

Director,  ONlt  Branch  Office 
Atter.tior.;  Dr.  1.  Clcyc 
1050  Las:  Creer  Street 
Pasadena,  CA  91106 

Director,  ON'S  Branch  Office 
Attention;  Kr . R.  Lavs on 
1030  East  Green  Street 
Pasadena.  CA  91106 

Office  of  Kaval  Research 
Scientific  Liaison  Croup 
Attention:  Dr.  M..,  Bcrtin 
Aaerican  Esbaasy  - Roob  A-407 
APO  San  Francisco  96503 

Dr.  A.  I.  Slafkosky 
Scientific  Advisor 

Cor.^andant  of  the  Marine  Corps  (Code  RD-1) 
Vashington,  DC  20360 

Headquarters,  Naval  Material  Coenand 
(Code  0331) 

Attention:  Dr.  Haber  C.  Moore 
Vashington,  DC  20360 

Dean  of  Research  Adelnistratlor. 

Naval  Postgraduate  School 
Attention:  Patrick  C.  Parker 
Mtrterey,  CA  93940 


Superintendent 

Naval  Postgraduate  School 

Attention:  R.  J.  Roland,  (Cede  32R1) 

C^  CurrlculvB 
Monterey,  CA  93940 

Naval  Personnel  Research  and  Devclopncnt 
Center  (Code  305) 

Attention:  LCDR  O' Bar 
San  Diego,  CA  92152 

Navy  Personnel  Research  and  Developnent 
Center 

Manned  Systans  Design  (Code  311) 
Attention:  Dr.  Fred  Muckier 
San  Diego.  CA  92152 

Kaval  Training  Equipvent  Center 
Human  Factors  Departsent  (Code  K215) 
Orlando,  FL  32613 

Kaval  Training  Equipcent  Center 
Training  Analvsis  anc  Evaluation  Creup- 
(Code  N-OOT) 

Attention:  Dr.  Alfred  F.  Ssode 
Orlando,  FI  32813 

Director,  Center  for  Advanced  Research 
Kaval  Var  College 
Attention:  Professor  C.  Levis 
Kevport,  R1  02640 

Naval  Research  Laboratory 

CoBBuni cat ions  Sciences  Division  (Code  54 

Attention:  Dr.  John  Shore 

Vashington.  DC  20375 

Dean  of  the  Acadeaic  Departaents 
V.S.  Kaval  Acadesv 
Annapolis,  MD  21402 

Chief,  Intelligence  Dlvislor 
Marine  Corps  Developnent  Center 
Quantico,  Va  22134 


Denar caent  of  the  Airv 


Deputv  Under  Secretarv  of  the  Arrv 
(Operations  Res  ear ch^ 

The  Pentapen.  Roer  21651 
Vashington.  DC  ICI-i: 


Dir tc tor,  Aray  library 
Amy  Studi«»  (ASDIAS) 

The  Pent«|on,  Aooo  IA534 
Vethinfton,  DC  20310. 

O.S.  Aroy  Rceiarch  Inatituta 

Orsanixatlona  and  Syataas  Reaaarch  Laboratory 

Attention;  Dr.  Edgar  M.  Johnaon 

3001  Eiacnhowcr  Avenue 

Alexandria,  VA  22333 

Director,  Organixatlona  and  Syatcss 
Aetearch  Laboratory 
U.S.  Arvy  Institute  for  the  Behavioral 
and  Social  Sciences 
3001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Technical  Director,  U.S.  Aray  Concepts 
Analvsis  Agency 
812C  WoocTT-cnt  Avenue 
Bethesda,  '10  20014 

Director,  Strategic  Studies  Institute 
U.S.  Amy  Conbat  Develoosents  Cosoand 
Carlisle  Barracks,  PA  17013 

Coasandant,  Arry  Logistics  Manageaent  Center 
Attention:  DRXMC-LS-SCAD  (ORSA) 

Ft.  Lee,  VA  23601 

Departcent  of  Engineering 
United  States  Military  Acadcny 
Attention;  COL  A.'  P.  Crum 
West  Point,  Kl'  10996 

Marine  Corps  Representative 
U.S.  Army  War  College 
Carlisle  Barracks,  PA  17013 

Chief,  Studies  and  Analysis  Office 
Kcaccuarters,  Arry  Training  and  Doctrine 
Comaanc 

Ft.  Monroe,  VA  23331 

Coraancer,  U.S.  Arry  Research  Office 
(Durhaci) 

6cx  O:,  Duke  Station 
Durhaa,  KC  27706 


Department  of  the  Air  Force 

Assistant  for  Requirements  Developaent 
end  Acquisition  Programs 
Office  of  the  Deputy  Chief  of  Staff  for 
Research  and  Development 
The  Pentagon,  Room  4C331 
Washington,  DC  20330 

Air  Force  Office  of  Scientific  Research 
Life  Sciences  Directorate 
Building  410,  Bolling  AFB 
Washington,  DC  20332 

Commandant,  Air  Unlversitv 
Maxwell  AFB,  AL  36112 

Chief,  Syataas  Effectiveness  Branch 
Human  Engineering  Division 
Attention;  Dr.  Donald  A.  Topnlller 
Vrlght-Patterson  AFB,  OH  45433 

Deputv  Chief  of  Staff,  Plant,  and 
Operations 

Directorate  of  Concepts  (AR/XOCCC) 
Attention:  Major  R.  Llnhard 
The  Pentagon,  Room  4U  104? 

Washington,  DC  20330 

Director,  Advanced  Svttcms  Division 
(AFHRL/AS) 

Attention;  Dr.  Cordon  Eckstranc 
Wright-Patterson  AFB,  OK  45433 

Commander,  Rome  Air  Development  Center 
Attention:  Mr.  John  Atkinson 
Criffia  AFB 
Rome,  KT  13440 

IRD,  Rone  Air  Develoooen:  Center 
Attention:  Mr.  Frederic  A.  Dion 
Crlffis  AFB 
Rone,  NT  13440 

KOS  Tactical  Air  Cersr.and 
Attention:  LTCOL  David  Oianich 
Langlev  A^B.  VA  23665 


Other  Covrnnent  AKencltt 


Chief,  Strategic  Evaluation  Center 
Central  Intelligence  Agency 
Headquarttra,  Rood  2C2A 
Washington,  DC  20S0S 

Director,  Canter  for  the  Study  of 
Intelligence 

Central  Intelligence  Agency 
Attention:  Mr.  Dean  Moor 
Washington,  DC  20505 

Mr.  Richard  Heuer 

Methods  4 forecasting  Division 

Office  of  Regional  and  Political  Analysis 

Central  Intelligence  Agency 

Washington,  DC  20505 

Office  of  Life  Sciences 
Headquarters,  National  Aeronautics  and 
Space  Adcinistratlon 
Attention;  Dr.  Stanley  Deutsch 
600  Independence  Avenue 
Washington,  DC  20546 


Other  Institutions 

Departffient  of  Psychology 
The  Johns  Hopkins  L’nlverslty 
Attention;  Dr.  Alphonse  Chapanls 
Charles  and  34th  Streets 
Baltimore,  MD  2L218 

Institute  for  Defense  Analyses 
Attention:  Dr.  Jesse  Orlansky 
400  Amy  Na\'y  Drive 
Arllr.cton,  VA  22202 

Director,  Social  Science  Research  Institute 
University  of  Southern  California 
Attention:  Dr.  Ward  Edwards 
Los  Angeles,  CA  90007 

Perceptror.lcs , Incorporated 
Attention;  Dr.  Aaos  Freedy 
6271  Variel  Avenue 
Woodland  Hills,  CA  91364 


Stanford  University 
Attention;  Dr.  R.  A.  Howard 
Stanford,  CA  94305 

Director,  Applied  Psychology  Unit 
Medical  Research  Council 
Attention;  Dr.  A.  D.  Baddcley 
15  Chaucer  Road 
Cambridge,  CB  2£f 
England 

DepartDent  of  Psychology 
Brunei  University 

Attention:  Dr.  Lawrence  D.  Phillips 
Oxbridge,  Middlesex  UBE  3PH 
England 

Decision  Analysis  Croup 
Stanford  Research  Institute 
Attention;  Dr.  Miley  V.  Merkhofer 
Menlo  Park,  CA  94025 

Decision  Research 
1201  Oak  Street 
Eugene,  OR  97401 

Department  of  Psychclotv 
University  of  Washington 
Attention;  Dr.  Lee  Roy  Beach 
Seattle,  WA  ‘98195 

Departcent  of  Electrical  and  Coeputer 
Engineering 

University  of  Michigan 
Attention:  Professor  Kan  Cher. 

Ann  Arbor,  Ml  94135 

Departoent  of  Governnent  and  Politics 
University  of  Maryland 
Attention:  Dr.  Davis  E.  Bebrov 
College  Park,  MD  20747 

Departoent  of  Psychologv 
Hebrew  Vniverslty 
Attentlcr. : Dr.  Aoos  Tverf'*;v 
Jerusaler.,  Israel 

Dr.  Andrew  P.  Sage 
School  of  Engineering  arc  Arpliec 
Science 

Vniversitv  cf  Vircinia 
Charlottesville,  V;  21- '1 


Professor  Revaond  Tantsr 
Politicsl  Sciencs  Depsttsenc 
The  University  of  Michigen 
Ann  Arbor,  Ml  48109 

Professor  Howard  Raiffa 
Morgan  302 

Harvard  Business  School 
Harvard  University 
Caebridge,  KA  02163 

Cepartaenc  of  Psychology 
University  of  Oklahosa 
Attention:  Dr.  Charles  Gettys 
435  West  Lindsey 
Dale  Hall  Tower 
Ncroar. , OK  73069 

Institute  of  Behavioral  Science  f3 
University  of  Colorado 
Attenticr. : Dr.  Kenneth  Kaaaor.d 
F.ezz.  201 

Bo'-lcer,  Colorado  80309 

Decisions  and  Designs,  Incorporated 
Suite  600,  8400  Uestpark  Drive 
P.O.  Box  907 
McLean,  Virginia  22101 


CL*ti>ric*TioN  n*  tmis  »/.cc  '■>•«•  />«f*  r.KffH) 


REPORT  DOCUMENTATION  PAGE 


READ  IMSTRUCTIONS 
OEFORE  COMnLl-.TINC  rCRM 


< MtMOnI  NUMOtK, 


t 


001922-tT 


1.  eovT  AccctiioN  NO 


*.  MCCiRiCNT't  Catalog  nungia 


TIT  I r fir** 


A Criterion  Validation  of  Multiattribute  Utility 
Analysis  and  of  a Group  Connunication  Strategy.  . 


t TVNc  or  ncaont  • Ncmoo  covcnco 


Technical  10/77-12/78 


A NcnroMMiNC  oac.  rcagat  numgcii 


ZErA 


1 Lee  C.  lEils,  111 
Richard  SyJohn 


1 conTaact  oh  onaat  NuMatnn; 

/—1m  Prljat.  Contract 
^ I ^ ^ I NOQO14-76-C79074  / 


10  hrochau  Cl  tMCiiT.  hhojC  :t.  task 
AREA  A AONA  unit  NUWItRi 


T RLRiORvjuC  CRG  At,:  2 ATlOh  NAME  akO  ADDRESS 

Social  Science  Research  Institute 
University  of  Southern  California 
Los  Angeles,  CA  90007 


>1  COSTROLUINC  OiriCE  NAVE  and  address 

Advanced  Research  Projects  Agency 
1400  Wilson  Blvd. 

Arlington.  VA  22209 


I 


Dec 


78 


s nuuocr  or  r aces 

2Sl 


'4  JaCIn  hamE.  <•  AtOOHCSSMi  Irom  CenirotJir.^  OltiC9) 

Decisions  & Designs,  Inc.^ 

Suite  100,  7900  Westpark  Drive 
McLean,  Virginia  22101 


1^  ICCu^l^v  ClAVS  (Aia  f»per;; 

Unclassified 


ISA  DEL.  .'SSiriC  ATIOK'  DDf.sS’;  •.D:;^C 
SCnEOu.E 


'6  D N|  B w ■^IC.  S'  i s 1 'of  l.Si  i Arro") 

Approved  for  public  release;  distribution-vnlluN^ed 


•!  i r 


f t 


■ t 7V- 


’■*  C>  STKiaoTiC*.  S’**TCmCnT  (ci  in^  efiiarerf  in  irIocA  ^6,  il  tfif/creni  Ircrr 


(^7 

1?  iL'PPu  A«V  notes  ' ^ 


»S  kLv  rO«OS  fCenr, 


1/ Aeceaa«i>*  lif«nilf>  P> 


Group  comnunication  strategy,  muUiattribute  utility  analysis,  utility, 
criterion  validity,  rank  weights,  rate  weights,  ratio  weights,  bank 
charge-card 


X \aPSTR4CT  fror.i.'fiu#  on  rovot»€  *fde  It  noco»*ofy  Mtf  Idenil/y  Vy  htoc:  numbor) 

■^This  study  investigates  the  use  of  an  external  criterion  for  validating 
additive  utility  assessments  under  certainty.  Utilities  were  elicited 
from  twenty-four  groups  via  consensus  Judgment  for  ten  hypothetical 
applicants  for  bank  credit  cards.  The  research  design  completely  crossed 
two  factors  relevant  to  group  utility  assessment:  (1)  using  a decomposi- 
tion (MAUA)  procedure  or  not,  and  (2)  using  a formal  group  communication 
strategy  or  not.  The  quality  of  each  group's  utility  Judgments  was  defined 


) janT  1 1473  lOiTiOH  OR  I NOV  CA  lA  OilOLfTE 

S/K  0I02'0I4' AAOl  I 


Unclassified 


AKCURITT  CLAAAiFiCATiCn  0»  This  aaCE  (l^^An  Daia  IniA.iu; 


■/O  6 ..  '/ 


* TV4A*,. 


Unclassified 

Cl*»i»iC*Tio>.  o»  TwiI  "AGlrwh**  B»|»  ii>i»t04i 
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